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This application claims priority to U.S. Provisional Application Serial No. 
60/173,071, filed on December 24, 1999 (P-8896), entitled "Automatic Voice and Data 
Recognition for Medical Device Instrument Systems." The disclosure and drawings of 
the Provisional application are specifically incorporated herein by reference. 



The present invention generally relates to the control of telemetry for implantable 
medical devices and instruments. Specifically, the invention relates to a method and a 
system for collecting diagnostic data from an implantable medical device (IMD). 



In recent years, implantable medical device technology has rapidly advanced. 
Sizes and weights of devices have decreased, while functionality has increased. These 
advances have created a corresponding demand for improved two-way communication or 
telemetry between the implantable medical device and an external device, for example, a 
programmer device. In a pacemaker system, for example, a programmer device 
downloads to an implanted pacemaker, data such as operating parameters. Likewise, data 
may flow from the implanted device to the programmer device. Modern pacemakers are 
capable of storing significant amounts of data about the patient, for example, the average 
heart rate, and information pertaining to the pacemaker itself, for example, battery 
voltage level. Generally, implanted device data is transmitted to the programmer device 
for review and evaluation by a physician. 



FIELD OF THE INVENTION 




BACKGROUND OF THE INVENTION 
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Current programming devices typically include an extendible head portion that 
includes an antenna. The antenna is connected to other circuitry in the programmer 
device via a stretchable coil cable. Thus, the head portion can be positioned over the 
patient's implanted device site for programming or telemetry interrogation of the 
implanted device. Command instructions or data that are downloaded to the implanted 
device are referred to as downlink transmissions, and data transmitted from the implanted 
device to the programmer device are referred to as uplink transmissions. 

Programming and pacing system analyzer units sometimes include graphic 
displays, keyboards or light pens for data entry and device control by a separate operator. 
During a surgical implant procedure the operator is sometimes located outside of the 
sterile environment of the operating room and receives commands for inputting data by 
the physician in the sterile environment. A programming head or wand is containing 
transceiver circuitry is positioned over a patient's implanted device site for programming 
and verification of proper placement of the implanted device during surgery. The 
implanting physician often cannot see the screen or display on the programmer because 
of the distance involved, size of screen and screen contrast limitations. This form of 
communication with the implanted device programming unit and operator is not only 
time consuming but the potential is high for miscommunication occurring between the 
physician and the programming unit operator. 

SUMMARY OF THE INVENTION 

Various embodiments of the present invention are directed to addressing the 
needs in connection with accurately inputting data and executing commands associated 
with medical data processing instruments using voice commands. 

According to one embodiment of the invention, a system that interfaces with an 
implanted medical device uses a voice control system to control a medical data 
processing instrument that performs tasks on the implanted device. The system includes 
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a microphone and a speech recognition circuit coupled to the microphone and adapted to 
recognize an audio signal from the microphone. The audio signal corresponds to one of a 
subset of commands from a set of commands and each command corresponds to a task to 
be performed on the implanted medical device. The speech recognition circuit is further 
5 adapted to convert the audio signal into a selection code and match the selection code to 
one of the subset of commands. The system further includes a display device and a 
processor arrangement coupled to the speech recognition circuit and to the display 
device. The processor arrangement is configured to receive data indicative of an 
implanted medical device state and select the subset of commands as a function of the 
y 10 device state. The processor arrangement is also configured to display the device state 

Hi data and the subset of commands and generate a control signal in response to the 

£V selection code match. The system also includes a medical data processing instrument 

f*\ coupled to the processor arrangement that is adapted to, in response to the control signal, 

m execute the one of the subset of commands and to display data generated in response to 

y 1 5 execution of the one of the subset of commands. 

[y According to another embodiment of the invention, a method for interfacing with 

m an implanted medical device uses voice control to control a medical data processing 

instrument that performs tasks on the implanted device. The method includes receiving 
data indicative of an implanted medical device state and selecting a subset of commands 
20 from a set of commands for performing tasks on the implanted medical device, the subset 
being selected as a function of the device state. The device state data along with the 
subset of commands is then displayed. An input audio signal from a microphone is then 
converted into a selection code, the input audio signal corresponding to one of the subset 
of commands. The selection code is then matched to one of the subset of commands and 
25 is then executed. Data generated by a medical data processing instrument is then 
received in response to execution of the one of the subset of commands. 
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The above summary of the present invention is not intended to describe each 
illustrated embodiment or every implementation of the present invention. The figures in 
the detailed description that follow more particularly exemplify these embodiments. 

5 BRIEF DESCRIPTION OF THE DRAWINGS 

The invention may be more completely understood in consideration of the 
following detailed description of various embodiments of the invention in connection 
with the accompanying drawings, in which: 

FIG. 1 illustrates a block diagram of an implanted medical device data processing 
10 instrument control system in accordance with an example embodiment of the invention; 
and 

FIG. 2 is a flowchart illustrating the manner of inputting data and executing 
commands on a medical data processing instrument in accordance with an example 
embodiment of the invention. 

15 While the invention is amenable to various modifications and alternative forms, 

specifics thereof have been shown by way of example in the drawings and will be 
described in detail. It should be understood, however, that the intention is not to limit the 
invention to the particular embodiments described. On the contrary, the intention is to 
cover all modifications, equivalents, and alternatives falling within the spirit and scope of 

20 the invention as defined by the appended claims. 

DETAILED DESCRIPTION 

The present invention is generally directed to an automatic voice authentication 
and limited data set recognition system that is content limited, is reliable and allows for 
25 hands-free user interactive control of medical data processing instruments, such as pacing 
system analyzers and implanted device programming units. While the present invention 
is not necessarily limited to such an application, the invention will be better appreciated 
using a discussion of example embodiments in such a specific context. 
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In an example embodiment, a medical data processing instrument, which interfaces 
with an implanted medical device, is controllable via voice commands that are noise 
suppressed with a noise suppression circuit. The voice commands are selected as a 
function of the implanted device state and a subset of the commands are selected from a 
5 set of commands that are provided on a display. In this manner, the data processing 
instrument user selects a command from the subset of commands in the context of the 
implanted device state and the subset of commands displayed. Upon receipt of the voice 
command via a microphone coupled to a speech recognition control circuit, the noise 
suppression circuit generates a noise-suppressed speech signal in response to noise 

10 suppression information received from the microphone. 

Referring now to the figures, FIG. 1 illustrates a voice controlled medical data 
processing instrument system 100 in accordance with an example embodiment of the 
present invention. System 100 includes a context speech recognition control system 102 
coupled to a medical data processing instrument 120, including a context data display 

15 arrangement 122, that is adapted to interface with an implanted medical device. The 
context speech recognition control system includes a microphone 104 coupled to a 
bandpass amplifier 106, which is coupled to a dynamic noise suppression circuit 108 and 
which is in turn coupled to a context speech recognition control circuit 110. Speech 
recognition control circuit 110 includes a speech authentication circuit 1 1 1 having a 

20 digital signal processor arrangement, a template memory 112 and a control signal 
generator 113 coupled to circuit 111 and memory 1 12. 

In an example embodiment, microphone 104 is a unidirectional microphone using a 
beam steering array arrangement to enhance voice sensitivity. Microphone 104 may be 
mounted on medical instrument 120 or alternatively, donned on the physician's clothing. 

25 In an example embodiment, the microphone is worn as a headset microphone or as a 

steerable microphone to improve voice command clarity. Bandpass amplifier 106 is used 
to reject background noise that is sensed by microphone 104. Noise suppression circuit 
108 provides further filtering of background noise to improve the clarity of the voice 
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command that is input to medical instrument 120. In particular, noise suppression circuit 
108 generates a noise-suppressed speech signal in response to noise suppression 
information received from the microphone. For a detailed discussion on noise 
suppression circuits compatible with the present invention, reference is made to U.S. 
5 Patent No. 4,737,976 to Borth et al, which is incorporated herein by reference. 
Context data display 122 and the processor arrangement of the speech 
authentication circuit 111 are configured to display data indicating a recent implanted 
medical device state along with a corresponding set of command options. Each of the 
commands of the command options are executable for further processing of the recent 

10 implanted medical device state by the medical data processing instrument 120. In one 
example application, instrument 120 is a programmer-analyzer that is used during 
implant medical device surgery to perform any one of the following: to test the position 
of the leads within a patient's heart, to set the threshold electrical energy delivered to the 
patient's heart by the implanted device, or to monitor the electrical signals produced by 

1 5 the patient's heart. Any or all of these actions are performed on demand and serve to 

further process the implanted device from its current or recent state into a new state when 
a certain command is received by instrument 120. For a detailed discussion of the actions 
that are performed by a programmer-analyzer, reference is made to U.S. Patent No. 
5,792,204 to Snell, which is incorporated herein by reference. 

20 Once the command is executed by medical instrument 120, the implanted device 

state data and available subset of commands corresponding to a particular implanted 
device state are provided via the display. In various embodiments, the display includes a 
display screen, a printed report generated by a printer, and/or an audio arrangement that 
emits an audible signal indicating the implanted device state and command options. For 

25 a detailed discussion of the operation of a programmer-analyzer, reference is made to 
U.S. Statutory Invention Registration HI 347 to Greeninger et al, which is assigned to 
the Assignee of the present invention and which is incorporated herein by reference. 
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The speech recognition control system of the present invention overcomes the 
drawbacks of current medical instruments, such as light pen data entry systems, which 
have exhibited a higher failure rate than is desirable, and voice data entry systems (e.g., 
Dragon Systems - Naturally Speaking Professional) that are slow, are prone to error and 
are incapable of deciphering between the various voices that are sensed by the 
microphone. The speech recognition control system of the present invention uses 
automatic voice authentication and limited data set recognition, which are context 
limited, for hands-free user interactive control of the medical instrument 120. With the 
speech recognition control system of the present invention, proper voice selection and 
distinction among several individuals in the operating room is possible such that only the 
physician and the programmer operator control the functions of the medical data 
processing instrument 120. Speech recognition is also simplified and reliability is 
improved since system 102 need only select voice commands from a limited vocabulary 
list in memory arrangement 112. 

In this example embodiment, speech authentication circuit 1 1 1 is adapted to 
recognize speech sets received from microphone 104 that include a command that is 
voice selected from the subset of commands that are displayed on the display 122. 
Speech authentication circuit 111 processes the command selected from the subset of 
commands through template memory 1 12 to ensure that the command is recognizable by 
the system. The control signal circuit 113 signals the medical data processing instrument 
120 to respond to the speech sets received from the microphone. Medical instrument 120 
is adapted to display data generated in response to execution of the voice select command 
from the subset of commands. 

Referring now to FIG. 2, a flowchart 200 illustrates the manner of programming 
and controlling a medical data processing system that interfaces with an implanted 
medical device in accordance with an example embodiment of the present invention. At 
step 202, a subset of commands (of a set of commands) corresponding to each implanted 
device state are generated, configured and stored in template memory 1 12 for later 
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display. Template memory 112 has a limited set of recognizable words which, in this 
example embodiment, includes about 30-50 words based on the context of the screen 
display, the specific commands available in the context of this screen (e.g., hypertext) 
and/or the present state of the implanted device under control. This approach provides a 
5 more reliable and less compute intensive voice authentication and recognition system. 
The authentication and recognition algorithm is based upon phonic assembly of words 
normally used with implanted devices. In this example embodiment, the speech 
authentication circuit in combination with the memory arrangement involves operator 
training in developing the dictionary of words to be stored in the template memory but 

10 does not need operator involvement in developing word recognition. In another 

embodiment, operator training is not necessary since system 102 is configured to have a 
limited vocabulary in memory from which command selections are made. 

At step 204, the speech authentication circuit is configured via a code to recognize 
certain users (physician, nurse, etc.) along with their corresponding authorized selection 

15 levels and in the manner that a user selects the commands. At step 206, display 122 

displays data indicating the implanted device state along with the subset of corresponding 
commands. At step 208, a voice selection of one of the displayed subset of commands is 
made by the physician and received by the speech recognition control circuit. At step 
210, the command is processed as an audio signal from the microphone and converted to 

20 a selection code. A determination is then made whether the voice command selection 
code matches or corresponds to the one of the subset of commands in memory for the 
displayed implanted device state. 

If the command is proper (code matches) with respect to the displayed device state 
and subset of commands provided from memory 1 12, a control signal from control signal 

25 circuit 1 13 is transmitted to medical data processing instrument 120 to execute the 

command and perform the task. The control circuit 113 generates control signals based 
on received commands from the speech recognition circuit 111, thereafter providing an 
input control signal to the medical instrument. Additional implanted device data is then 
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displayed in response to the medical data processing instrument executing the voice- 
selected command. In one example embodiment, the additional data displayed includes a 
subsequent device state along with another subset of commands. If the command is 
improper or not recognized by the speech control circuit 111 and memory 112, the 
display does not change and the flow of the process returns to step 206. In another 
example embodiment, a message is displayed on the display, or an audible tone is 
generated, indicating to the physician that the selected command was either executed 
(confirmation message or tone) or was not executed (error message or error tone). In yet 
another embodiment, the command confirmation, positive or negative, is represented by 
an audible voice repetition of the given command and confirmation of receipt/processing 
of the command. 

In an example embodiment, a remote communications link is optionally established 
at step 204 as part of the authentication process with an additional data processing center 
that includes a physician or technicians that specialize in the area of implanted devices. 
The additional data processing center is remotely located and the retrieval of information 
is performed over a communications network. At the center, a physician or healthcare 
specialist provides remote analysis of the data and approves changes in therapy or 
diagnosis via voice commands that are sent to the speech recognition circuit 111. 

The present invention provides, in an example application, non-invasive clinical 
data measurement or control of various HMDs, using the voice controlled medical 
instrument system, including but not limited to drug pumps, neurological implants, nerve 
stimulators, various cardiac implants and equivalent medical devices. The present 
invention is compatible to a number of techniques for programming and interrogating 
implanted medical devices. In addition, embodiments described are compatible with 
remote patient management systems that interact with remote data and expert data centers 
and compatible with a data communications system that enables the transfer of clinical 
data from the patient to a remote location for evaluation, analysis, data reposition, and 
clinical evaluation. 



10 



# 



Various modifications, equivalent processes, as well as numerous structures to 
which the present invention may be applicable will be readily apparent to those of skill in 
the art to which the present invention is directed upon review of the present specification. 
The claims are intended to cover such modifications and devices. 



